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ABSTRACT 

This paper compares descriptive Information based on 
analyses of the pilot and live administrations of the Alabama High 
School Graduation Examination (AHSGE) . The AHSGE, a product of 
decisions made in 1977 and 1984 by the Alabama State Board of 
Education, Is composed of subject tests In reading, mathematics, and 
language. The pass score for each subject test was established using 
empirical and judgmental methods based on data from the Initial pilot 
administration. Therefore, it Is essential that the live 
administration data be consistent with the Initial pilot cT.ata. The 
purpose of this study was to validate the test development procedure 
by comparing the difficulty level of common test Items measuring 
competencies on the Initial Item pilot and on the live 
administration. The data were collected during 2 phases of pilot 
testing and 16 live administrations of the AHSGE. The lnlt\al Item 
pilot tested 40 schools, with 560 students statewide for each of tne 
4 test forms. In 1983 form pilot tests, there were about 1,200 
llth-grade students. Over 46,000 students participated In the first 
live administration. The stability of the difficulty level of common 
items was demonstrated, as was the consistency of the difficulty 
level of the parallel forms of the AHSGE from Initial pilot through 
live administrations. Results support the test development procedures 
jf the AHSGE. Fourteen tables present summary data, and an e.lght*-ltem 
list of references Is Included. (SLD) 
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Introduction 

This paper contains a comparison of descriptive information based on analyses of the 
pilot and live administrations of The Alabama High School Graduation Examination (AHSGE). 
The AHSGE is a product of decisions made in 1977 by the Alabama State Board of 
Education; moreover, in 1981, new requirements for graduation from high school were 
approved which mandated that students pass a minimum competency examination in addition 
to earning the required Carnegie units (McLean, 1984). The AHSGE is composed of three 
subject tests: Reading, Mathematics, and Language. The pass score for each subject test of 
the AHSGE was established using empirical and judgmental methods (Halpin, 1984; Roth, 
1984) based on data from the initial pilot administration; therefore, it is essential that the live 
administration data are consistent with the initial pilot data. The purpose of this study was to 
validate the test development procedure by comparing the difficulty level of common test 
items measuring competencies on the initial item pilot and on the live administration. 

The data were collected during two phases of pilot testing and sixteen live administrations 
of the AHSGE. The following section summarizes the item pilot procedure, the form pilot 
procedure, and the comparisons of pilot data to the live administration data. 

Item Pilot Procedure 

The Initial item pilot procedure was conducted by the Educrtional Testing Service. 
According to an October 1, 1982 memorandum from the State Superintendent of Education, 
Wayne Teague, the item pilot procedure was conducted November 1 6-1 8, 1 982. All public 
schools in Alabama with at least 50 students were among the population which was randomly 
sampled to participate in the item pilot procedure. The state of Alabama was divided into four 
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regions determined by student population. Fourteen schools and five alternates were 
randomly selected from eacli of tlie four regions. 

Tliere were ten bool<lets of test items. There were three test bool<lets for reading items, 
another three test bool<lets for mathematics items, and four test bool<lets for language. 
Table 1 snows the number of students involved in the item pilot at school, district, and state 
levels. 



TABLE 1 ■ 

Number of Students Involved In Item Pilot 
at School, District, and State Level 


Form 


School 


Number of Students 


District 


State 


(A)-Reading, Mathematics, Language 


10 


140 


560 


(B)-Reading, Mathematics, Language 


10 


140 


560 


(C)-Reading, Mathematics, Language 


10 


140 


560 


(D)-Language 


10 


140 


560 


Total 


40 


560 


2240 



Note: This table is based on information included with a memorandum from 
the Alabama State Superintendent of Education to City and County 
Superintendents of systems. 



According to the records of the Alabama State Department of Education, approximately one 
percent of the 55,000 eleventh grade Alabama students (for the 1982-83 academic year) were 
rando-.ily selected. 

Analysis of Pilot Items 

Once the pilot items were administered, the Evaluation and Assessment Laboratory at The 
University of Alabama analyzed the data from results. The difflcuity level and discrimination 



index for all pilot Items were oalculated. The difficulty level indicated tlie proportion of 
students who completed the item correctly. The discrimination index showed how well the 
Item discriminated between students who scored high and students who scored low on all 
test items in the pilot item booklets. The pilot Items were analyzed to determine whether they 
were sexually or ethnically biased. All questionable items were eliminated from the item pool. 
The next step ir. the pilot procedure involved the pilot testing of forms. The next section of 
this paper will provide a brief overview of the procedures involved. 

1983 Form Pilot Procedures 

Two equivalent forms of the AHSGE were developed from the pool of pilot items for 
reading, mathematics, and language. The Form Pilot was administered during April 1983. 
The reading pilot forms were Forms 11 and 12; the mathematics pilot forms were Forms 23 
and 24, and the language pilot Forms were forms 35 and 36. The reading, mathematics, and 
language pilot forms were administered on April 26, 27, and 28, 1983, respectively. The same 
1982-83 eleventh grade class was usod for the form pilot; however, no school participated in 
both the item pilot and the form pilot. 

SamoiinQ Procedure 

The approximately 450 schools were arranged into five achievement strata based upon 
the average California Achievement Tests performance of the 1981-82 tenth grade cla*5s (the 
eleventh grade class of 1982-83). Once the schools were arranged into five achievement 
strata, eight schools and two alternate schools were selected from each strata using random 
sampling procedures. A proportional sample was taken from each of the eight schoois until 
the sample size was approximately 240 per strata. 



An alphabetized list of eleventh grade students from the randomly selected schools was 
obtained. The student lists were numbered and random numbers were generated for each 
form of the test. One set c' students received Forms 1 1 , 23, and 35 for reading, mathematics, 
and language respectively, and the other set of students in the school received the other 
forms for eacn subject area. Approximately 600 students received Forms 1 1 , 23, and 35 and 
approximately 600 students received Forms 12, 24, and 36. There were about 1,200 students 
in the total sample from the approximately 55,000 student population for the 1 982-83 eleventh 
grade class. Although each of the five strata had two alternate schools available in case of 
an emergency, none of the alternate schools were used. 



Analyste 

Table 2 describes the summary statistics for tlie pilot forms. The reliability coefficients 
ranged from .95 to .96 for all pilot forms. 



Summary Statistics for the Pilot Forma of the AHSGE 


Subject 
Form 


n 


Number of 
Items 


M 


SC 


Cronbach 
Alpha 


Reading 




Form 1 1 


609 


80 


72.03 


10.66 


.95 


Form 12 


610 


80 


71.37 


11.14 


.95 


Mathematics 




Form 23 


610 


95 


72.77 


16.26 


.95 


Form 24 


610 


95 


73.18 


16.11 


.96 


Language 




1 Form 35 


615 


119 


99.12 


17.54 


.96 


1 Form 36 


616 


119 


98.32 


18.58 


.96 



Note ; The sample included about 1231 students out of a population of about 
55,000 eleventh graders in the 1982-83 academic year. 



Live Administration of the AHSGE 
In October 1983, over 48,000 eleventh grade Alabama students participated in the first live 
administration of the AHSGE. At the time of this study, there have been seventeen additional 
administrations of the AHSGE. Since the Fall 1983 (Form A) and Spring 1985 (Form B) live 
administration forms were essentially the same items as those used in the form pilot in April, 
1983, the difficulty level from these two forms were used to compare the difficulty levels on 
different steps in test development. The purpose of this comparison is to demonstrate the 



stability of the difficulty level from the initial item pilot to the form pilot and then to the live 
administration of these same items. 



Table 3 describes summary statistics for Forms A and B on live administrations during Fall 
1983 and Spring 1985 respectively. 



TABLE 3 

Summary Statistics for the Live Administration of Forms A and B' 


Sulilaci 
Form 


n 


Number of 
items 


M 


SD 


Cronbach 
Alpha 


Reading 




Form A 


48,612 


60 


73.15 


12.45 


.97 


Form B 


1,549 


80 


73.57 


9.38 


.95 


Mathematics 




Form A 


48.612 


95 


76.83 


16.82 


.96 


Form B 


1,549 


95 


76.85 


15.08 


.96 


Language 




Form A 


48.612 


119 


101.18 


19.63 


.97 


Form B 


1,562 


100** 


86.22** 


13.29 


.95 



* Form A was administered during Fall 1983 which was the Hrst live administration of the 
AHSGE and Form B was administered Spring 1985. The^e summarv statistics were 
computed for answer sheets with "first attempt" indications. 



The language examination was shortened to 100 items. 
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Tables 4 through 13 provide a comparison of the average difficulty level on the initial item 
pilot, the form pilot, and the live administration for Forms A and B for reading, mathematics, 
and language. The overall difficulty level for these three developmental stages differs no 
more than one percent for Form A snd Form B at each administration. 



TABLE 4 

A Comparison of the Average Difficulty Level (percentage correct) on the 
Initial Item Pilot of the AHSQE for Reading 



Competency 
Number 


Competency Uescrfption 


Number 

Of 

Items 


Form 
A 


Form 
B 


i-1 , 2: IV-1 3 


WORDS IN DAILY LIFE; FILLING OUT FORi\^S 


8 


88.03 


88.81 


11-1 


CONTEXT CLUES 


5 


1 83.98 


83.18 


III-1 


PREFIXES & SUFFIXES 


4 


87.95 


87.15 


III-2 

III fm 


ABBREVIATIONS 


4 


93.73 


93.13 


iV-1 


ALPHABETICAL ORGANIZATION 


6 


86.52 


86.48 


IV-3 


REFERENCE SOURCES 


4 


87.35 


87.35 


IV-4 


BOOK SECTIONS 


4 


81.28 


81.00 


IV-5 


NEWSPAPER SECTIONS 


4 


92.78 


92.65 


IV-6 


MAIN IDEA: PASSAGES 


5 


83.52 


81.58 


IV-7 


FIND DETAILS IN A WRITTEN PASSAGE 


5 


87.90 


91.90 


IV-8 


USE MPPS, GRAPHS, CHARTS, AND 
TABLES 


6 


91.05 


90.95 


IV-9, 10, 11 


MAIN IDEA AND DETAIL: GOVERNMENT, 
LAW, MONEY MANAGEMENT, NUTRITION 


9 


86.69 


86.04 


IV-1 4 


ADS, LABELS, CATALOGS, AND 
DIRECTORIES 


6 


91.20 


91.12 


V-1 


FOLLOWING DIRECTIONS AND 
INSTRUCTIONS 


6 


89.45 


88.43 


VI-1 


FACT AND OPINION 


4 


79.85 


82.40 


Total 


80 


87.53 


87.56 
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.Bail..,..,,;.,', 

AOompWittonof^d Averagdb^^^ onthd =- 

rorm Pifot ihi^ AH8QE for neadfiig 



Competency 
Number 


Competency Description 


Numoer 

of 
Items 


Form 
A 


Form 1 
B 1 


1-1,2: IV-13 


WORDS iN DAILY LIFE; FILLING OUT FORMS 


8 


92.31 


90.99 


11-1 


COI^BCr CLUES 


5 


85.72 


86.52 


IIM 


PREFIXES AND SUFFIXES 


4 


92.20 




88.50 


III-2 


ABBREVIATIONS 


4 


95.85 


95.85 


IV-1 


ALPHABETICAL ORGANIZATION 


6 


88.80 


87.80 


IV-3 


REFERENCE SOURCES 


4 


93.55 


92.10 


IV-4 


BOOK SECTIONS 


4 


84.85 


83.13 


IV-5 


NEWSPAPER SECTIONS 


4 


93.88 


94.05 


IV-6 


MAIN IDEA: PASSAGES 


5 


87.68 


83.56 


IV-7 


FIND DETAILS IN A WRITTEN PASSAGE 


5 


88.68 


92.20 


IV-8 


USE MAPS, GRAPHS, CHARTS. AND TABLES 


6 


92.12 


90.32 


IV-9, 10, 11 


MAIN IDEA AND DETAIL: GOVERNMENT, 
LAW, MONEY MANAGEMENT, AND 
NUTRITION 




88.77 


88.97 


IV-1 4 


ADS, LABELS, CATALOGS, AND 
DIRECTORIES 


6 


91.67 


92.73 


V-1 


FOLLOWING DIRECTIONS AND 
INSTRUCTiONS 


6 


89.08 


87.33 


VI-1 


FACT AND OPINION 


4 


85.00 


83.55 


Total 


80 


90.10 


89.25 
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ACdmptt^ Averajji DIfficuliy Uvel fijercerrtage correct) on ihd v : ^ 
j^UveAdmlnlrtfattoriof^^ 



ComDetoncv 
Number 


Competency Description 


Number 

of 
Items 


Form 
A 


Form 1 
B 1 


1 l-1,2:IV-13 


WORDS IN DAILY LIFE; FILLING OUT FORMS 


8 


93.00 


92.00 


11-1 


CONTEXT CLUES 


5 


88.60 


90.20 




PREFIXES AND SUFFIXES 


4 


93.00 


88.25 1 


III-2 


ABBREVIATIONS 


4 


96.25 


95.75 1 


IV-1 


ALPHABETICAL ORGANIZATION 


6 


91.83 


91.67 1 


IV-3 


REFERENCE SOURCES 


4 


93.50 


93.00 


IV-4 


BOOK SECTIONS 


4 


86.75 


83.00 


IV-5 


NEWSPAPER SECTIONS 


4 


95.25 


96.00 


IV-6 


MAIN IDEA: PASSAGES 


5 


90.60 


ae on 


II ^'^ 


FIND DETAILS IN A WRITTEN PASSAGE 


5 


92.80 


95.20 


1 IV-8 


USE MAPS, GRAPHS, CHARTS, AND TABLES 


6 


94.83 


94.00 


1 IV-9, 10, 11 


MAIN IDEA AND DETAIL: GOVERNMENT, 
LAW, MONEY MANAGEMENf, NUTRITION 


9 


92.89 


93.33 


IV-1 4 


ADS, LABELS, CATALOGS, AND 
DIRECTORIES 


6 


94.50 


95.50 


V-1 


FOLLOWING DIRECTIONS AND 
INSTRUCTIONS 


6 


93.83 


93.67 


1 VI-1 


1 rACT AND OPINION 


4 


87.50 


88.25 


1 Total 


80 


92.50 


92.00 
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A conipwison ot Vm AVoragQ DiTficuiiy Li9V9I \pvrceruage Qommj on in© 
: Ititt Pliot^f the 


Competency 
Number 


g% m mkAm» annum aMmI V%AKtf%W^ 

competency Description 


Number 

nf 
OT 

Items 


rurni 
A 


ruiiii 
B 


1-1 


READ AND WRITE: MONEY VALUES, NUMBERS 


3 


92.47 


93.40 


1-2 


COMPARE DECIMALS: COMPARE FRACTIONS 


3 


66.07 


65.93 


1-3 


COMPUTATION: WHOLE NUMBERS 


6 


92.72 


92.93 


1-4 


COMPUTATION: DcUlMALS 


C 

O 


QA CD 


00. lU 


1-5 


COMPUTATION: rRACTIONS 


c 
O 




ftn on 


1-0 


CONVcnblON: UbCIMALo ANU to 


w 




^fl 77 


1-7 


A DDI IPATI^KI* DATinM OL PlIQP TAYCQ 

ArrUUAIlUN, nAIIUiN, to, UIqU, IAacO, 

COMMISSION 


A 
H 






1-8 


CONVERSION: FRACTIONS AND DECIMALS 


4 


62.80 


62.80 


1-9 


AVERAGES OF WHOLE AND DECIMAL NUMBERS 


3 


75.93 


76.10 


1-10 


CONVERSION: UNITS OF MEASURE 


4 


43.90 


42.20 


11-1 


SOLVE PROBLEMS INVOLVING TIME 


3 


66.60 


70.33 


11-2 


MEASURE LENGTHS BY USE OF A RULER 


4 


71.45 


69.83 


11-3 


CAPACITIES 


3 


77.00 


77.50 


11-4 


FIND PERIMETERS 


4 


89.35 


89.10 


li-5 


FIND RECTANGULAR AREAS 


4 


31.50 


29.28 


111-1,2 


INTERPRET: GRAPHS, TABLES, CHARTS 


4 


78.58 


78.48 


Ih-o 


IKITCDDDCT* CPA! C HDAIA/IM^C 

IN 1 bnr He 1 . uCALc UnAWINbio 


q 
0 


7ft 07 


ftn on 


lV-1 


ADDD^V DV D^l IMHIM^ Ml ll^ilDCnC 

ArrnUA, Di nUUNUINu NUMdcMO 


o 
o 


ftO 1 ^ 


ftO fVI 


IV-l , 2, 3 


ubUMClnlU rUnlViQ AINU UUiMUkrIo 


e 
O 


ftQ Qfi 


ftQ do 


VI-1 , 2, 3 


Uc 1 bnMINc CHANcib. CUMrU 1 b UUO 1 , 

COMPUTE CASH/CREDIT PURCHASE 


O 


70 ftQ 


7Q in 


VI-4 


ALLOCATE TIME AND MONEY 


3 


63.77 


63.60 


VI-5 


COMPLETE CHECKS AND MONEY ORDERS 


3 


76.03 


72.77 


VI-6 


SOLVE RATE, TIME, DISTANCE PROBLEMS 


3 


76.50 


76.30 


VI-7 


COMPUTE SALARIES AND WAGES 


4 


73.43 


73.08 


Total 


95 


72.47 


72.48 
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TABLES 

A Comparison of the Average Difficulty Level (percentage correct) on ttie 
Form Pilot of tfie AHSGE for Matfiematics 



Competency 
Numoer 


Competency Description 


Number 

of 
Items 


Form 
A 


Form 
B 


1-1 


READ AND WRITE: MONEY VALUES, NUMBERS 


3 


95.67 


94.37 


1-2 


COMPARE DECIMALS: COMPARE FRACTIONS 


3 


71.73 


75.37 


1-3 


COMPUTATION: WHOLE NUMBERS 


6 


93.22 


94.72 


1-4 


COMPUTATION- DECIMALS 


6 


87.67 


87.73 


1-5 


COMPUTATION: FRACTIONS 


6 


66.88 


64.88 


1-6 


CONVERSION: DECIMALS AND PERCENTS 


3 


68.50 


71.87 


1-7 


APPLICATION: RATION, %, DISC, TAXES, COMM 


4 


84.33 


66.98 


1-8 


CONVERSION: FRACTIONS AND DECIMALS 


4 


61.78 


66.80 


1-9 


AVERAGES OF WHOLE AND DECIMAL NUMBERS 


3 


80.30 


80.07 


1-10 


CONVERSION: UNITS OF MEASURE 


4 


51 .60 


47.15 


11-1 


SOLVE PROBLEMS INVOLVING TIME 


3 


72.87 


74.97 


11-2 


MEASURE LENGTHS BV USF! OF A RULER 


4 


70.68 


66.90 


11-3 


CAPACITIES 


3 


81.63 


91.23 


11-4 


FIND PERIMETERS 


4 


88.40 


91.23 


11-5 


FIND RECTANGULAR AREAS 


4 


38.33 


37.10 


111-1,2 


INTERPRET: GRAPHS, TABLES, CHARTS 


4 


81.65 


80.53 


III-3 


INTERPRET: SCALE DRAWINGS 


3 


84.33 


80.30 


IV-1 


APPROXIMATIONS BY ROUNDING NUMBERS 


3 


85.37 


85.40 


IV-1,2, 3 


GEOMETRIC FORMS AND CONCEPTS 


6 


91.15 


93.22 


VI-1,2, 3 


DETERMINE CHANGE: COMPUTE COST, 
COMPUTE CASH/CREDIT PURCHASE 


6 


79.47 


78.08 


VI-4 


.A '.LOCATE TIME AND MONEY 


3 


69.53 


71.87 


VI-5 


COMPLETE CHECKS AND MONEY ORDERS 


3 


85.90 


83.03 


VI-6 


SOLVE RATE, TIME, DISTANCE PROBLEMS 


3 


81.17 


83.50 


VI-7 


COMPUTE SALARIES AND WAGES 


4 


78.28 


79.40 


Total 


95 


76.48 


77.17 
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TAD! C A 

TABLE 9 

A Comparison of the Average Difficulty Level (percentage correct) on the 
Live Administration of the AH8GE for Mathematics 


Competency 
nuiTiD6r 


Competency Description 


Number 

of 
items 


Form 
A 


Form 
B 


1-1 
1" 1 


PFAn AND WRITF- MONP/ VALUES NUMBERS 


3 


95.33 


95.67 


1 . 
1 


nnMPAPP npniMAi comparp fractions 


3 


74 67 


76.00 


1-0 


pnMPiiTATinM' wwni p mmiuirpr^ 


6 


95 C3 

WW* WW 


95 67 

wW* W f 






6 


90 17 


"^2 50 


1-0 




6 


72 17 


66 83 

WW* WW 




rnN\/PR^inM' npniiuiAi^ amd pprcpnts 


3 


78 33 


75 33 

r W*WW 


1-7 
If 


APPLICATION* ration % DISC TAXES COMM 


4 


67 25 


68.75 


1-8 


CONVPRSION* FRACTIONS AND DECIMALS 


4 


72 25 


73.75 


l-Q 


AVPRAGPS OF WHOLE AND DECIMAL NUMBERS 


3 


85.67 


83.67 


MO 


CONVERSION* UNITS OF MEASURE 


4 


55 00 

WW* WW 


49.50 


11-1 


SOIN/P PRORl PM<5 INVOlVINtt TIME 


3 

W 


75 67 

f W« W f 


78 67 

f W* W f 




MPASURP I FNOTHS BY USE OF A RULER 


4 


85 75 

WW* f w 


80.00 


no 


CAPACITIES 


3 

w 


86 00 

WW* WW 


92 00 

Wfci* WW 




FIND PPRIMETERS 


4 


92 50 

Wfci* WW 


91.75 


11-5 


FIND RECTANGULAR ARIEAS 


4 


50.25 


48.00 


111-1,2 


INTERPRET: GRAPHS, TABLES, CHARTS 


4 


85.50 


83.50 


III-3 


INTERPRET: SCALE DRAWINGS 


3 


86.33 


83.33 


IV-1 


APPROX. BY ROUNDING NUMBERS 


3 


90.67 


88.00 


IV-1.2, 3 


GEOMETRIC FORMS AND CONCEPTS 


6 


87.33 


94.83 


VI-1,2, 3 


DETERMINE CHANGE: COMPUTE COST, 
COMPUTE CASH/CREDIT PURCHASE 


6 


86.00 


84.00 


VI-4 


ALLOCATE TIME AND MONEY 


3 


74.33 


73.33 


VI-5 


COMPLETE CHECKS AND MONEY ORDERS 


3 


90.00 


87.33 


VI-6 


SOLVE RATE, TIME, DISTANCE PROBLEMS 


3 


89.00 


88.67 


VI-7 


COMPUTE SALARIES AND WAGES 


4 


87.25 


84.50 


Total 


95 


81.58 


80.93 
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TABLE 10 



A Comparison of the Average Difficulty Level (percentage correct) on the 
Initial Item Pilot of the AHSGE for Language 



Competency 
Number 


Competency Description 


Number 
of 
Items 


Form 
A 


Form 
B 


1-1 


PRONOUN-ANTECEDENT AGREEMENT 


9 


93.39 


93.38 


1-2 


CORRECT FORMS OF NOUNS AND VERBS 


15 


79.94 


80.17 


11-1 


IDEAS IN SEQUENTIAL ORDER 


5 


80.94 


80.94 


11-2 


SENTENCES ORGANIZED 


9 


80.49 


80.51 


11-3 


ARRANGE DIRECTIONS IN LOGICAL ORDER 


4 


86.58 


86.73 


IV-1 


INCLUDE NECESSARY INFO FOR MESSAGE OR 
REQUEST 


4 


85.30 


85.28 


IV-2 


DETERMINE MISSING OR IRRELEVANT INFO 


4 


85.63 


85.55 


V-l 


PROPER FORMAT OF A BUSINESS LETTER 


9 


62.48 


62.34 


V-2 


PROPER FORMAT OF A FRIENDLY LETTER 


8 


70.79 


70.59 


VI-1 


COMPLETE COMMON FORM OR APPLICATION 


9 


82.64 


82.54 


VII-1 


SPELLING 


9 


88.30 


88.33 


VIII-1,2, 3,4 


PERIODS, QUESTION MARKS, EXCLAMATION 
POINTS, COMMAS, APOSTROPHES 


16 


78.63 


78.62 


VIII-5 


QUOTATION MARKS 


4 


66.13 


66.15 


VIII-6 


COLONS 


4 


64.15 


64.10 


IX-1 


CAPITALIZATION 


10 


87.59 


87.55 


Total 


119 


80.00 


80.00 
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TABLE 1 1 

A Comparison or the Average Difficulty Level (percentage correct) on the 
Form Pilot of the AHSGE for Language 


Competency 

NUmOGr 


Competency Description 


Number 
of 

lici no 


Form 

A 


Form 
B 


1-1 


PRONOUN-ANTECEDENT AGREEMENT 


9 


95.53 


94.50 


1-2 


CORRECT FORMS OF NOUNS AND VERBS 


15 


83.55 


81.79 


11-1 


IDEAS IN SEQUENTIAL ORDER 


5 


83.52 


84.16 


11-2 


SENTENCES ORGANIZED 


9 


83.52 


75.70 


11-3 


ARRANGE DIRECTIONS IN LOGICAL ORDER 


4 


88.43 


88.73 


IV-1 


INCLUDE NECESSARY INFO FOR MESSAGE OR 


4 


88.05 


88.30 


IV-2 


DETERMINE MISSING OR IRRELEVANT INFO 


4 


88.33 


89.00 


V-1 


PROPER FORMAT OF A BUSINESS LETTER 


9 


67.90 


69.16 


V-2 


PROPER FORMAT OF FRIENDLY LETTER 


8 


75.18 


76.10 


VI-1 


COMPLETE COMMON FORM OR APPLICATION 


9 


83.87 


85.53 


VII-1 


SPELLING 


9 


91.08 


89.76 


VIII-1.2, 3,4 


PERIODS, QUESTION MARKS, EXCLAMATION 
POINTS, COMMAS, APOSTROPHES 


16 


83.99 


83.53 


VIII-5 


QUOTATION MARKS 


4 


65.60 


69.48 


VIII-6 


COLONS 


4 


76.08 


72.75 


iX-1 


CAPITALIZATION 


10 


89.50 


88.24 


Total 


119 


83.48 


82.69 



ERIC 



14 

16 



TABLE 12 ■ 

A Comparison of the Average Difficulty Level (percentage correct) on the 
Live Administration of the AHSGE for Language 




Competency 
Number 


Competency Description 


Form A 

# 
Items 


Form A 


Form B 

JL 
ff 

Items 


ruriii 

B 


1-1 


PRONOUN-ANTECEDENT AGREEMENT 


9 


95.89 


8 


95.25 


1-2 


CORRECT FORMS OF NOUNS AND VERBS 


15 


82.83 


4 A 

12 


81.58 


11-1 


IDEAS IN SEQUENTIAL ORDER 


5 


85.60 


4 


. 88.25 


11-2 


SENTENCES ORGANIZED 


9 


M ^ ^n 
84.56 


6 


80.17 


11-3 


ARRANGE DIRECTIONS IN LOGICAL ORDER 


4 


OA C A 

89.50 


4 




IV-1 


INCLUDE NECESSARY INFO FOR MESSAGE 
OR REQUEST 


4 


91 .75 


4 




IV-2 


DETERMINE MISSING OR IRRELEVANT INFO 


4 


91 .25 


4 


93.00 


V-1 


PROPER FORMAT OF A BUSINESS LETTER 


9 


76.44 


6 


78.00 




PROPFR FORMAT OF A FRIENDLY LETTER 


8 


81.13 


5 


Ow.OU 


VI" 1 


COMPL FTP COMMON FORM OR 
APPLICATION 


9 


87.22 


8 


9w. 1 0 


VII-1 


SPELUNG 


9 


91.11 


8 


90.75 


VIII-1.2. 3.4 


PERIODS, QUESTION MARKS, 
EXCLAMATION POINTS, COMMAS, 
APOSTROPHES 


16 


86.44 


14 


85.29 


VIII-5 


QUOTATION MARKS 




70.75 


4 


73.75 


VIII-6 


COLONS 




83.75 


4 


74.25 


IX-1 


CAPITALIZATION 


4 ^ 
1 


91.10 


9 


89.78 


Total 


119 


86.05 


100 


86.27 



ERIC 



TABLE 13 



A Comparison of the Average Difficulty Level (percentage correct) on the 
Item Pilot, the Form Pilot, and the Uve Administration of the 
AHSQE for Reading, Mathematics, and Unguage 

Total Tests 



Subject 


Item Pilot 


Form Pilot 


Live Administration 


Form A 
Fall 1982 


Form B 
Fall 1982 


Form A 
Spring 1983 


Form B 
Spring 1983 


Form A 
Fail 1983 


Form B 
Spring 1985 


Reading 


87.53 


87.56 


90.10 


89.25 


92.50 


92.00 


Mathematics 


72.47 


72.48 


76.48 


77.17 


81.58 


80.92 


Language 


80.00 


80.00 


83.48 


82.69 


86.05 


86.21 
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Table 14 provides the summary statlstic3 for all live administrations from Form 0010 which 
was administered in Fall 1983 through Form 0160 which was administe-^d in Spring 1991. 
Odd numbered forms were administered in the fall of each year and the following even 
numbered forms were administered in the spring of each year. As shown In Table 14, the 
difficulty level and the discrimination Index have remained relatively stable over the sixteen live 
administrations. 

Summary 

This paper has provided a comparison of the difficulty level of common items measuring 
competencies on the initial item pilot, the form pilot, and the live administration of the AIHSGE. 
The significance of the study was the demonstration of the stability of the difficulty level of 
common Items from the pilot administrations to the live administrations of the AHSGE. Also, 
this study demonstrated the consistency of the difficulty level for the parallel forms of the 
AHSGE from the Initial pilot through actual live administrations. At each stage of the AHSGE 
development or administration, the average difficulty for the parallel forms differed no more 
than one percent as shown In Table 13. As expected, the difficulty level of items was slightly 
lower on the pilot administrations than on the live administration; however, the discrimination 
Index remained relatively stable. The results of this study support the validation of the test 
development procedures used for the AHSGE. 
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Summary Statistics for Live Forms of the AHSGE 



Subject 

I Ul III 


n 


# 
Of 
Items 


Mean 
Difficulty 
Level* 


M 


Mean 
Discrimination 
Index* 


SO 


Cronbach 
Alpha 


R0010 


48 612 


80 

WW 


.9249 


73.15 


.5873 


12.45 


.973 




1 285 


80 

Ww 


8922 


71.37 


.4962 


11.74 


.959 


R0030 


46 754 

~ W 1 f w~ 


80 

Ww 


.9531 


74.86 


.4392 


08.19 


.944 


R0040 


1 549 

1 1 W~w 


80 

Uw 


.9200 


73.57 


.4471 


09.38 


.948 


R0050 


47,953 


80 


.9357 


74.81 


.4309 


07.88 


.939 


R0060 

1 Iwwww 


1 629 


80 


.9119 


72.95 


.4822 


10.48 


.956 




48 849 

~ W 1 W » w 


80 

WW 


.9265 


74.09 


.3949 


07.74 


.928 




2 028 

b| WbW 


80 

WW 


.9230 


73.85 


.4595 


09.54 


.952 


1 Iwwww 


49 048 

» W 1 w » w 


80 

WW 


.9240 


73.92 


.3772 


07.48 


.920 




2 322 


80 


9342 


74 74 


.4065 


07.84 


.936 


RO1 10 


46 725 


80 


Q436 


75 49 


.3801 


06.77 


.923 


nu 1 C.U 


P1d4 


RO 

uU 


9075 


72 60 


3827 

• W Wb f 


08.48 


.926 


nu 1 ou 


4R 147 


RO 
ou 


Q4R^ 


75 62 


3911 

• WW 1 1 


06 84 

W W • W J 


.928 


R0140 


2,187 


80 


.9043 


72.34 


.3932 


08,71 


.929 


R0150 


44,176 


80 


.9468 


75.74 


.3829 


06.62 


.924 


R0160 


2,164 


80 


.9075 


72,60 


.4185 


09.07 


.937 


















M0010 

www \0 \0 i ^# 


48,612 


95 


.8158 


76.83 


.4745 


16.82 


.964 


M0020 


1,260 


95 


.7737 


73.50 


.4289 


16.39 


.958 


M0030 

i W i W W WW 


46,806 


95 


.8300 


78.85 


.3995 


14.05 


.950 


M0040 

PWi w w » w 


1,562 


95 


.8093 


76.85 


.4202 


15.08 


.955 


M0050 

IWI WW WW 


48,067 


95 

WW 


.B345 


79.22 


.3786 


13.12 


.943 


M0060 

Ivl WWWW 


1 540 

i 1 w^ w 


95 

WW 


.8009 


76.09 


.4194 


15.33 


.955 


M0070 

1 V 1 WW f W 


48.949 


95 


.8517 


80.90 


.3733 


12.61 


.943 


M0080 

IT IWW WW 


1,975 


95 


.8039 


76.38 


.3918 


14.73 


.950 


M0090 


49,123 


95 


.8496 


80.72 


.3530 


12.00 


.936 


M0100 


2.272 


95 


.8206 


77.91 


.3835 


13.34 


.946 


M0110 


46,819 


95 


.8442 


8020 


.3529 


12.01 


.935 


l\40120 


2,138 


95 


.8089 


76.85 


.3720 


13.82 


.944 



erJc 



Mncludes some error due to rounding 



TABLE 14 ' 

Summary Statistics for Live Forms of the AHSGE 
(Based on First Attempts Only) 



Subject 

rornfi 


n 


# 
Of 
nems 


Mean 
Difficulty 

LGV6I 


M 
IVI 


Mean 
Discrimination 




. Cronbach 

Mipria 


IVlUl OU 




90 




on no 


•OOU%7 


1 ^•Of 


Q^Q 


M0140 


2,152 


95 


.8111 


77.05 


.3649 


13.37 


.940 


MG150 


44,263 


95 


.8419 


79.98 


.3534 


12.08 


.935 


M0160 


2,161 


95 


.8062 


76.59 


.3929 


14.40 


.948 


















L0010 

^WW 1 w 


48 612 


119 


8605 

• WwWw 


101 18 

1 W 1 • 1 o 


5002 

• wWW& 


19 63 

1 w^WW 


972 

• w r ^ 


L0090 


1 290 


119 

1 1 w 


8274 

• W& 9 ^ 


98 44 

wW^"T~ 


4422 


19 23 

1 W^bW 


966 

• www 


L0030 


46 778 


100 

1 WW 


8779 

• w r r w 


87 82 

W 9 • Wfci 


3994 

• www^ 


12 33 


.945 


L0040 


1 562 


100 

1 WW 


8627 


86 22 

WW^fcto 


4121 


13.29 


.949 


L0050 


48 030 


100 

1 WW 


8967 

• Www 9 


89 61 

Ww^W 1 


3903 

• WWWW 


11 24 


941 

• W~ 1 


L0060 


1 582 


100 

1 WW 


8574 

• Ww 9 "T 


85 74 

Ww^ 9 "T 


4243 


14 00 

1 "•WW 


953 

• www 


L0070 


48 887 


100 

1 WW 


8816 

• WW 1 w 


88 10 


3501 

■ WwW 1 


10 49 

1 W^^w 


924 

• Wb^ 


Looao 


2 022 


100 

1 WW 


8614 

• WW 1 ~ 


86 13 

WW^ 1 w 


3895 

• WWwW 


12 71 

1 •*• 9 1 


942 

• w^^ 


L0090 


49 047 


100 

1 WW 


8899 

• WWWW 


89 00 

WW^ WW 


3320 

• WWKbW 


09 63 

WW^ WW 


.915 


L0100 


2 347 


100 

1 WW 


8607 

• www 9 


86 05 

WW* WW 


3677 

• WW V f 


11.70 


933 

• www 


L0110 


46 773 


100 

1 WW 


9008 

• WWWW 


9008 

WW^ WW 


3546 

• WW 1 w 


10 06 

1 W^ WW 


.928 


L0120 


2 14S 


100 

1 WW 


8441 


84 41 


3180 

• W 1 WW 


10 70 

1 W^ 9 W 


910 

• W 1 w 


L01 30 


45 218 


100 

1 WW 


8964 

• WW w^ 


89 64 

WW^ W~ 


3530 

• WWWW 


10.13 


927 

• WSb f 


L0140 


2,172 


100 


•8524 


85.24 


•3199 


10.63 


.913 


L0150 


44,164 


100 


•8967 


89.67 


•3569 


10.22 


.928 


L0160 


2,256 


100 


•8422 


84.22 


•3585 


11.73 


.927 



*lncludes some error due to rounding 
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